Evolutionary reconstruction of networks 
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Can a graph specifying the pattern of connections of a dynamical network be reconstructed from 
statistical properties of a signal generated by such a system? In this model study, we present 
an evolutionary algorithm for reconstruction of graphs from their Laplacian spectra. Through a 
stochastic process of mutations and selection, evolving test networks converge to a reference graph. 
Applying the method to several examples of random graphs, clustered graphs, and small- world 
networks, we show that the proposed stochastic evolution allows exact reconstruction of relatively 
small networks and yields good approximations in the case of large sizes. 

PACS numbers: 89.75.-k, 89.75.Fb, 05.10.-a 



The operation of network-organized systems of differ- 
ent origins is determined by the pattern of connections 
between their elements. The principal framework for in- 
vestigations of dynamical networks is provided by graph 
theory [ R g, [|, Q . Recently, properties of various so- 
cial Hp |, linguistic |Q, biochemical || and neural net- 
works g[§, of the WWW and the Internet g2|, 
have been analyzed. Statistical mechanics of systems 
with network organization has been reviewed |l3| . Much 
effort is invested in the understanding how the structure 
of a network is mapped to its function and determines 
its operation. On the other hand, in applications rang- 
ing from bioengineering to neurosciences one also needs 
to design networks with a given function or reconstruct 
a network from its dynamics. Taking into account the 
great complexity of network dynamics, explicit solutions 
of such inverse problems of graph theory are difficult. But 
graph reconstruction may also be achieved without any 
knowledge of rules, by running an artificial evolution pro- 
cess through which a network learns to generate certain 
dynamics by adjusting its internal organization. Indeed, 
evolutionary algorithms are known to yield efficient so- 
lutions for complex optimization problems For the 
problem of graph reconstruction, such an approach has 
previously been proposed (ll| |l6| . 

In this Letter, we present an evolutionary algorithm 
and apply it to reconstruct graphs from their Lapla- 
cian spectra. Random graphs, small-world networks and 
networks with cluster organization are considered. We 
show that for relatively small graphs, exact reconstruc- 
tion within a reasonable evolution time is possible. For 
larger graphs, the evolution leads to a network which pro- 
vides a good approximation of the target graph. Both the 
spectral properties as well as other characteristic features 
of the reference network, such as the diameter, clustering 
coefficient, and the average degree, are well reproduced 
by the approximately reconstructed graph. 

Any graph G can be described by its adjacency ma- 
trix A such that Aij = 1 if the nodes i and j are con- 
nected, and = otherwise. A Laplacian spectrum 
of the graph G is defined B as the set of eigenvalues Xi 



of the matrix T with elements Ti, 
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Aij — rriiSij where 
1 A^ is the degree of node i and Sij is the Kro- 



necker symbol. 

Laplacian spectra are closely related to dynamical 
properties of a simple network: Consider a hypotheti- 
cal linear "molecule" consisting of N identical particles 
connected by identical elastic strings. The pattern of 
connections is defined by a graph G: a bond between 
particles i and j in the network is present if the respec- 
tive element A^ in the adjacency matrix of the graph 
G is equal to unity and absent otherwise. This dynami- 
cal system is described by a set of differential equations 
Xi + ^2jLi Aij(xi — Xj) = for the coordinates Xi of 
all particles. Obviously, the vibration frequencies u>k of 
such a molecule (fc = 0, 1, . . . , N — 1) are given by the 
eigenvalues A& = — u)\ of the matrix T. Note that one 
eigenvalue Ao always satisfy Ao = due to the trans- 
lational invariance of this equation. For this reason, the 
Laplacian spectra of a graph are also known as the vibra- 
tional spectra Q. Besides yielding a link to dynamical 
networks, spectra provide a powerful invariant character- 
ization of graphs. Each graph of size N is thus mapped 
into a set of JV — 1 positive real numbers u>i. Various 
statistical properties of graphs can be expressed or evalu- 
ated in terms of their spectra Moreover, even though 
cospectral graphs (topologically different graphs with the 
same spectra) are known to exist, their fraction is very 
small |^(J. Hence, with a high probability two graphs 
with coinciding spectra would indeed be identical. 

It is convenient to introduce the spectral density p{u) 
for a graph as a sum of narrow Lorentz distributions 
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with the same width 7 and the normalization constant C 
chosen in such a way that J Q p(u>)duj = 1. The spectral 
distance e between two graphs G and Go with densities 
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p(uj) and Po{uj) can then be defined as 




\p{u) - p {w)fdu. (2) 



Our aim is to reconstruct graphs from their Laplacian 
spectra. Note that the number Mjv of different graphs 
of a given size N becomes (super) astronomically large 
even for relatively small sizes. A lower bound for Mjv 
is 2 N ( N - 1 ^ 2 /N\, so even for N = 50 we have M N > 
1.9 x f0 304 . Therefore, finding an exact solution to the 
inverse problem by subsequently testing all graphs is in 
practice impossible. Instead, we shall use an evolutionary 
procedure for graph reconstruction. 

Suppose that we want to reconstruct a certain refer- 
ence graph Go with the spectral density po(u>). In order 
to do this, we generate an arbitrary initial graph G and 
introduce a stochastic process of mutations and selec- 
tion. The mutations represent random modifications of 
the pattern of connections whereas the selection is based 
on the spectral distance (||) between two graphs. 

A mutation of the graph G first consists of deleting all 
connections of a randomly chosen node i. A new degree 
rrii for this particular node is then chosen at random 
between 1 and N — I followed by a random generation 
its rrii new connections. The obtained mutated graph is 
denoted as G'. 

To decide whether a mutation should be accepted (that 
is, to realize a selection), we calculate the spectral dis- 
tance e' between the modified graph G' and the reference 
graph Go- This is then compared with the spectral dis- 
tance e between G and Go- If Ae = e' — e < 0, the mu- 
tation is always accepted. If Ae > 0, the mutation is ac- 
cepted with a certain probability p(Ae) = exp(— Ae/e6). 
When a mutation has been accepted, the graph G is re- 
placed by G'. 

These two steps are applied iteratively and the evolu- 
tion is continued until the spectra are identical (e = 0) or 
the spectral distance e is smaller than a given threshold. 
Note that mutations may be accepted even if Ae > 
to avoid that the evolution gets trapped in a local min- 
imum. The noise of the selection is controlled by the 
"temperature" parameter 9. The scheme is similar to 
the Metropolis algorithm used in statistical mechanics 
and complex combinatorial optimization |l7], |l8) . 

In the following, this procedure is applied to recon- 
struct three different types of reference graphs. 

Random networks. First we consider the case where 
the reference network is a random graph of size ./V and 
connection probability p. As an example, we take a ref- 
erence graph Go with N = 10 and p = 0.2. The initial 
graph Gi n it is also random, but has a higher connection 
probability p = 0.9. The two graphs and their Lapla- 
cian spectra are shown in FIG. [l]a-b. We then apply the 
stochastic evolution, described above, with the selection 
temperature 9 — 0.044 . The evolution of the spectral 
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FIG. 1: Graphs Go, Ginit, and G nn ai (note that Go and G nn ai 
are identical) (a). Spectral densities of Go (solid line) and 
Ginit (dashed line) (b). One stochastic evolution of the spec- 
tral distance e(i) (c). Dependence of the final mean spectral 
distance e on the selection temperature 9 (d). Parameters are 
7 = 0.08 (b-d) and 9 = 0.044 (c). 

difference e is shown in FIG. |l|c. The spectral distance is 
gradually decreasing, with some fluctuations, until even- 
tually a transition occurs at t ~ 3500, when the spectral 
densities of the reference and test graph coincide. Exam- 
ining the final graph Gfi na i in FIG. |l|a, we conclude that 
it is indeed identical to the reference graph Go- Note 
that though the number of graphs of size N — 10 is of 
the order of 10 6 , the exact reference graph has been re- 
constructed in only 3500 stochastic iterations. 

To determine the reliability of the reconstruction and 
its dependence on the selection temperature 9, a statis- 
tical investigation has been performed. The variation of 
the mean spectral distance e as a function of 9 is shown 
in FIG. |j]d where each point corresponds to the average 
over 10 3 evolutions each starting from a randomly chosen 
test graph with connection probability chosen randomly 
from [0, 1]. Each evolution was terminated after 4 x 10 4 
iterations. We see that there is a window of the selec- 
tion temperature 9 where fast convergence takes place. 
At the minimum 9 = 0.04 approx. 92 % of all evolutions 
converge exactly to the reference graph within the spec- 
ified time. 

Clustered networks. Next, we consider large clustered 
networks representing a union of several random graphs 
with different connection densities. As an example, a ref- 
erence network Go of size N — 50 with three clusters of 
high connection probability is chosen. To prepare it, a 
sparse random graph of size N with low connection prob- 
ability p — 0.05 is first generated. Then three random 
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FIG. 2: Spectral densities of the clustered reference graph 
(solid line), and of the initial and final graphs (dashed and 
dotted lines) of one stochastic evolution (a). Time depen- 
dences of the mean spectral distance e{i) and of the ratios 
L(t)/Lo, C(t)/Co, and D(t)/Do averaged over 10 3 evolutions 
(b). Parameters are 7 = 0.08 and 9 = 0.002; for the reference 
graph L = 4, Co = 0.263, and D = 7.04. 

dense clusters of size -/Vi oca i = 8 with connection prob- 
ability piocai = 0.8 have been constructed and added to 
the sparse graph. The spectrum of Go exhibiting two 
distinct peaks is shown by a solid line in FIG. ^a. The 
reconstruction was tested by running 10 3 stochastic evo- 
lutions starting from different random graphs with con- 
nection probability chosen randomly between [0,1]. The 
spectra of one such initial graph and of the correspond- 
ing final graph obtained after 10 5 iterations are shown 
in FIG. ||a. Even though the exact reconstruction is not 
reached in this case, the spectral densities of the final 
and of the reference graphs in FIG. ||a are very similar 
(e = 0.057), and differ greatly from that of the initial 
graph. 

Though exact reconstruction is not reached for the con- 
sidered large graph, statistical analysis reveals that the 
properties of the final graph are close to that of the ref- 
erence graph. FIG. ||b shows the time dependence e(t) 
of the mean spectral difference averaged over the 10 3 
stochastic evolutions. We see that e decreases down to 
about 0.056 after 10 4 iterations. Other important prop- 
erties of the reference graph, such as its diameter L, clus- 
tering coefficient G, and its mean degree D (all defined as 
in the review E^j), are also well-reproduced. This is seen 
from FIG. ||b, where the time dependence of the mean 
ratios L(t)/L Ql C(t)/C , and D(t)/D is presented. 

Similarity between graphs can also be discussed in 
terms of their adjacency matrices: For any two graphs 
G\ and G2 with adjacency matrices Ai and A2, a trans- 
formation F = F(Ai, A2) can be introduced as 

F = U^UaAaVjVi. (3) 

Here the real matrices U12 and V12 are defined by 
the singular- value decomposition jl9| of Ai and A2. If 
two graphs are identical and their adjacency matrices 
only differ because of a different enumeration of nodes, 
the identity Ai = F(Ai,A2) holds and the difference 
A = Ai — F is zero. On the other hand, if two graphs G\ 
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FIG. 3: Density plots of the adjacency matrix Ao of the clus- 
tered reference graph and of the matrices Finit an d Ffi na i (see 
the text). 



and G2 do not coincide, the norm 6 = l/-/VQ3ij A^ ) 1 / 2 
of this difference can be used as a measure of the distance 
between the graphs. 

In FIG. H we visually display the matrices Ao, 
F init = F(A , A^t), and F flna i = F(A ,A final ) where 
Ao, Ai„it and Afi na i are the adjacency matrices of the 
graphs Go, Gi„;t and Gfi na i. Here the elements in the 
matrices are represented by a square array of pixels us- 
ing gray-scale color maps whose limits are determined by 
the minimum and maximum values of the respective ma- 
trix elements. Even though the matrix Ffi na i does not 
coincide with Ao, it is already very close to it. The re- 
spective distances 6 for the initial and final graphs are 
S-uat = 0.41 and <5 fina i = 0.04. 

Small worlds. Now we consider a small-world graph 
(see ||) consisting of N = 40 nodes organized on a ring 
with each node connected to its two neighboring nodes. 
In addition, each node i is connected to a randomly cho- 
sen node j in the network (j ^ i ± 1) with the proba- 
bility p — 0.1. The adjacency matrix of this reference 
graph is visually displayed in the left frame of FIG. ||a. 
To test the reconstruction efficiency for this graph, we 
have performed 10 3 stochastic evolutions, each starting 
from a random graph with connection probability chosen 
randomly from the interval [0, 1]. The spectra of the ref- 
erence, initial and final graphs of one particular evolution 
are shown in FIG. [|b; we see that even fine structures of 
the reference spectrum have been reproduced. The struc- 
ture of the final graph is also close to that of the reference 
graph as seen from the last two frames in FIG-Ha where 
the matrices F init and F final defined by Eq. (|3]) are dis- 
played (the respective distances S for the initial and final 
graphs are 6^ — 0.92 and (5fi na i = 0.01). 

The time dependence of the mean spectral distance 
e(t) and the ratios L(t)/Lo, C(t)/Co, and D(t)/Do av- 
eraged over 10 3 evolutions is shown in FIG. ^c. After a 
transient of 10 4 iterations, e = 0.058 and all three ratios 
have approached unity implying that these characteristic 
properties of the reference network also are well-captured 
by the approximate reconstruction process. 

Our analysis has revealed that the proposed evolution- 
ary algorithm provides an efficient method for exact or 
approximate reconstruction of graphs from their Lapla- 
cian spectra. Based on the spectral density only, such 
important properties of the reference network as its di- 
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FIG. 4: Density plots of the adjacency matrix Ao of a small- 
world reference graph and of the matrices Finit and Ffl na i (a). 
The corresponding spectral densities for the reference, initial, 
and final graphs (solid, dashed, and dotted lines, respectively) 
(b). Time dependences of the mean spectral distance e(t) and 
of the ratios L(t)/Lo, C(t)/Co, and D(t)/Do averaged over 
10 3 evolutions (c). Parameters are 7 = 0.08 and 8 — 0.021; 
for the reference graph Lq = 8, Co = 0.063, Do = 2.65. 



amctcr, clustering coefficient, and average degree arc well 
reproduced. Moreover, approximately reconstructed net- 
works have similar adjacency matrices determining the 
pattern of connections between nodes. Unique evolution- 
ary reconstruction is not possible for cospectral graphs, 
but these are, however, extremely rare gj. Our numerical 
study has been performed using a fixed selection temper- 
ature in the evolutionary algorithm; more refined algo- 
rithms employing a time dependent temperature (similar 
to the method of simulating annealing 18 ) can also be 
implemented. 

The spectral density (Q) of a graph may be interpreted 
as representing a power spectrum of a certain stochas- 
tic signal z(t). This signal can be, for instance, gener- 
ated by vibrations of a damped elastic "molecule" un- 
der action of external white noise. Such a linear dy- 
namical system would be described by the equations 
Xi + j±i + Y,f=i Aij(xi - Xj) = £i(t), where &(t) are in- 
dependent random forces and Aij is the adjacency ma- 
trix of the graph. We have shown that the structure of 
this simple model system can be reconstructed from its 
temporal signal z(t) = ^2;CiiXi(t) with randomly chosen 
weights at. Thus, we see that important network infor- 
mation can be encoded into a stochastic signal and then 
efficiently recovered from it. 

In essence, the proposed stochastic evolution can be 
regarded as a learning process through which a test net- 
work, by adjusting its internal structure, learns to ap- 
proximate the dynamics generated by a different system. 
Similar approaches can be applied to solve other prob- 
lems. For instance, approximations of large clustered 



graphs by graphs of a smaller size can be constructed, and 
networks generating stochastic signals with prescribed 
power spectra can be designed. 

The results of our model study put forward questions 
whether network organization of complex nonlinear dy- 
namical systems with deterministic chaos can be recon- 
structed from their power spectra in an evolutionary 
learning process and whether, generally, a nonlinear net- 
work may learn to generate given complex chaotic dy- 
namics by iteratively adjusting its pattern of connections. 
A practical solution of these problems would be impor- 
tant for a variety of applications. 
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For N < 6, there is only one pair of connected cospectral 
graphs. For regular graphs, one pair of size 12, two pairs 
of size 16, a cospectral quadruple of size 28, seven cospec- 
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tral pairs of size 25, and a set of 91 cospectral graphs of 
size 35 have been found (see Ji)). 



